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CLAIMS 

1 . An automatic evaluation method for automatically evaluating a 
program operating on a target system by referring to an output screen as 
a result of a simulation to an arbitrary input event, the automatic evaluation 
method characterized in that: 

the simulation is performed, a timing when data renewal of the output 
screen on which its result is reflected becomes definite is reported, 
reference to the output screen is made in accordance with the timing, and 

a result of the reference is compared with reference data prepared 
in advance so that an automatic evaluation is carried out. 

2. An automatic evaluation method as set forth in claim 1, 
characterized in that the timing when the data renewal of the output screen 
becomes definite is determined by monitoring the passage of a predetermined 
time defined in advance. 

3. An automatic evaluation method as set forth in claim 1, 
characterized in that the timing when the data renewal of the output screen 
becomes definite is determined based on data which is finally prepared by 
carrying out a logical sum operation of individual simulation results at 
predetermined intervals of time. 

4. An automatic evaluation method as set forth in claim 1, 
characterized in that the timing when the data renewal of the output screen 
becomes definite is reported by a display rewriting completion event from 
the program operating on the target system. 

5 . An automatic evaluation method as set forth in any one of claims 
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1 to 4, characterized in that the simulation is stopped when reference to 
the output screen is made. 

6. An automatic evaluation system for automatically evaluating a 
program operating on a target system by referring to an output screen as 
a result of a simulation corresponding to an arbitrary input event, the 
automatic evaluation system comprising: 

a simulation unit for performing the simulation of an operation 
of the program and monitoring a timing when data renewal of the output screen 
on which its result is reflected becomes definite; and 

an automatic evaluation unit for obtaining from the simulation unit 
the timing when the data renewal of the output screen becomes definite, 
referring to the output screen at the timing, and carrying out an automatic 
evaluation by comparing a result of the reference with reference data prepared 
in advance. 

7. An automatic evaluation system as set forth in claim 6, 
characterized in that the simulation unit comprises: 

■a simulator for performing the simulation; and 

a timing monitor portion for obtaining the timing when the data 
renewal of the output screen becomes definite by communicating with the 
simulator. 

8. An automatic evaluation system as set forth in claim 7, 
characterized in that the timing monitor portion includes a timer for 
monitoring the passage of a predetermined time defined in advance. 

9. An automatic evaluation system as set forth in claim 7, 
characterized in that the timing monitor portion includes an arithmetic 
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logic unit for carrying out a logical sum operation of individual simulation 
results at predetermined time intervals and a determination according to 
the finally prepared data. 

10. An automatic evaluation system as set forth in claim 7, 
characterized in that the timing monitor portion includes a decoder which 
receives a display rewriting completion event from the program operating 
on the target system and decodes the display rewriting completion event. 

11 . An automatic evaluation system as set forth in any one of claims 
6 to 10, characterized in that the simulation is stopped when the reference 
to the output screen is made. 

12 . A storage medium storing an automatic evaluation program for 
automatically evaluating a program operating on a target system by referring 
to an output screen as a result of a simulation corresponding to an arbitrary 
input event, in which the automatic evaluation program comprises: 

a step of reading an input event and reference data prepared in 
advance for the individual input event; 

a step of successively transmitting the read input event to trigger 
execution of the simulation; 

a step of obtaining a notification of a timing when data renewal 
of the output screen on which a result of the simulation is reflected becomes 
definite and referring to the output screen in accordance with the timing; 
and 

a step of carrying out an automatic evaluation by comparing a result 
of the reference with the reference data. 



